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The Underlying Premise... 



The ability to engineer reliable, 
high-capacity direct interfaces to the 
brain and then integrate these into a 
host of new technologies will cause 
the world of tomorrow to be much 
different than that of today. 




However... 


0 There are some serious scientific barriers between 
where we stand today and where we can stand in 
the future. 

• How do we establish permanent and reliable interfaces to 
selected areas of the central nervous system? 

• How do we use these interfaces to directly and reliably 
communicate at high rates with the brain? 


Applied Neural Implants and Control 
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Primary Goals of the 
BIO:INFO:MICRO Project 


> Develop new neural implant 
technologies to establish 
reliable, high-capacity, and long- 
term information channels 
between the brain and external 
world. 
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> Develop real-time signal 
processors and system 
controllers to optimize 
information transmission 
between the brain and the 
external world. 
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Systems-level Approach... 
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Objective 2: Optimize Objective 7: Optimize neural 

Adaptive Controller interface 



Topics 


M Project overview 

□ Towards the Development of Next- 

Generation Neural Implants (BIO, MICRO, 
and INFO) 

□ Bioactive Coatings to Control the Tissue 
Responses to Implanted Microdevices 

□ Modeling the Device-Tissue Interface 

□ Direct Cortical Control of an Actuator 

□ Neural Control of Auditory Perception 

□ Wrap-up 


Focus on Next-Generation 
^^NeuraMmglants^^ 
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Objective 2: Optimize 
Adaptive Controller 


Feedback signals : local 
host response 
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Objective 7: Optimize neural 
interface to achieve reliable, two-way, 
high-capacity information channels. 
...and “self-diagnostic” 


Fundamental Problem of Implantable 
Microelectrode Arrays 


> Brain often encapsulates the device with scar tissue 

> Normal brain movement may cause micro-motion at the tissue- 
electrode interface 

> Proteins adsorb onto device surface 

> Useful neural recordings are eventually lost 
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3 rd -Generation Neural Implants 
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1 st -generation 2 nd - generation 

Microwires Silicon arrays 




Technology 

Spectrum 


3 rd -generation 
Neural Implants 
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4 shanks spaced at 150pm 
4 sites'shank spaced at 100pm 
Shanks are 2mm long 
('able is 1cm lot\g 
Sites are 313pm“ 


Desired Properties 

• Very high channel count 
(< 1000 ) 

• Bioactive coatings 

• Flexible 

• Engineered surfaces 

• Controlled biological 
response 

• Integrated electronics 



“Brain-centered” Design of Neural Implants 


Initial conceptual designs 






Polymer-substrate Neural Implants 



• 2-D planar devices can be bent into 3-D structures 

• Increases insertion complexity 


- Holes to 
promote 
integration 
with neuropil 


90 degree 
angles 




Recordings From Polymer-substrate 
^_^_NeuraMm]2!ants^_^^ 


One Day Post-op 



Lost most unit activity 
after 7 days - Most likely 
due to failure to properly 
close dural opening. 


Flexible Neural Implants Present 
_^^uj2ical B Challencies^ M ^ 


0 While the “micro-motion” hypothesis suggests that flexible 
neural implants should be more stable, the same flexibility 
presents significant new surgical challenges. 


“Difficult” insertion “Easy” insertion 
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Using Dissolvable Coatings to 
^^Stiffen^h^NeuraMnn^ant^^ 


0 Dip-coat microdevice with polyethylene glycol (PEG) 


• Provides mechanical stiffening prior to implant 

• Quickly dissolves when in contact with tissue 


First insertion of coated microdevice into 
gelatin -- Device easily penetrates 
material 



Second insertion of coated microdevice 
into gelatin - The device is too flexible to 
penetrate material because the PEG has 
dissolved. 



Micromachined Surgical Devices 


Silicon Knife/Inserter 



Vacuum Actuated Knife/Inserter 


Exploratory Functionality 
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Multiple Dimensions and Forms 







Implant Coatings and Surface Modifications 


Parylene-N,C 



P h oto-c rossl i n ked 
Polyimides 




Surface Plasma Treatments 

(NH 3 - Amination) 





Advanced Neuro- Device Interfaces 


Passive 


▼ 

Chemical/Electronic 

Amplification 


▼ 

Active 




uuuuu — ion beam 



metal 

site or interdigits 

release layer 
or substrate 


modified region 
polymer (Pl/P-C) 


Silicon FETs? 



Topics 


M Project overview 

M Towards the Development of 3 rd - Generation 
Neural Implants (BIO, MICRO, and INFO) 

□ Bioactive Coatings for Controlled 
Biological Response (bio, micro, and info) 

□ Modeling the Device-Tissue Interface 

□ Direct Cortical Control of an Actuator 

□ Neural Control of Auditory Perception 

□ Wrap-up 


Approach 


Engineer the neural implant surface in order to control 
both the material response and the host response. 
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Advanced biomaterials and 
micro-devices for long-term 
implants (BIO, MICRO, INFO) 


Models and 3-D visualization 
of device-tissue dynamics 
(BIO, INFO) 



Cellular and biochemical 
response characterization 
(BIO, MICRO) 


Factors Limiting Chronic 
^oft^TissueJmglants^ 


0 Inability to control cellular interactions at 
biomaterial-tissue interface 

0 Initial adsorption of biological proteins 

• Non-selective cellular adhesion 

0 Unavoidable “generic” foreign body reactions 

• Inflammation 

• Fibrous capsule formation 


Potential Solution 


0 Engineer surface for minimal protein adsorption 
and selective cell adhesion 

• Cell-resistant polymer coatings 

• Synthetic: Polyethylene Glycol, Polyvinyl Alcohol 

• Natural: Polysaccharides, Phospholipids 

• Surface immobilization of biologically active 
molecules 

• Mimic biochemical signals of extracellular matrix 

• Cell binding domains for integrin receptors 


Biomimetic Surface Modification 
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Material Surface 
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Bioactive Functionality 


Methods 




NeuroTrace™ Dil tissue-labeling paste, 
inverted fluorescent microscope with 
FITC/rhodamine filter cube 






Topics 


^ Project overview 

^ Towards the Development of 3 d -Generation 
Neural Implants (BIO, MICRO, and INFO) 

M Bioactive Coatings to Control the Tissue 

Responses to Implanted Microdevices (bio, micro, 

and INFO) 

□ Modeling the Device-Tissue Interface 

(BIO, MICRO, and INFO) 

□ Direct Cortical Control of a Motor Prosthesis 

□ Neural Control of Auditory Perception 

□ Wrap-up 


The Device-Tissue Interface 


Neural Interface: 

Micro-device, Neurons, Glia, Extracellular Space 


The Goal is to Characterize, Predict, and Control 

the Device-Tissue Interface 


Tissue State 

(e.g., encapsulation, "C 
excitability) 


Biophysical 
Model of the 
Device-Tissue 
Interface 




Device Function 

(e.g., impedance 
spectrum) 


• Integrate bioelectrical, histological and biochemical data 

• Optimize electrode specifications 


Visualization of the Chronic Device-Tissue 
^InterfaceWithConfocal^ 




In vivo Visualization of the Chronic 
Device-Tissue Interface 






Multi-Domain Continuum Model 



Tissue is two (or more) coupled 
volume-conducting media 

Electrode is boundary condition 


At each "point" r in space: 
volume fraction f eli (r) 
potential <E > e/i (r,t) 
conductivity tensor G eli (r) 
membrane parameters 
a, C, g L , etc. 


Equations for a Multi-Domain 
Continuum Model 


Volume conductor equations (conservation of current) 
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i = index over intracellular domains 


Membrane potential(s) and membrane current(s) 
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0 /( = potential (mV) a i — surface to volume ratio (cm 1 ) y.= membrane potential (mV) 

G eli = conductivity (mS/cm) I memi = membrane current (pA/cm 3 ) q = membrane capacitance (pF/cm 2 ) 

f eli = volume fraction I app = applied current (pA/cm 3 ) I ioni = membrane current (pA/cm 2 ) 


Levels of Modeling 


Numerical 

Multiple intracellular domains 
Voltage-dependent conductances 

= L S,J n ( V . ~ E i) 

i k 
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* x*(v;) 


Complex electrode geometry 

Tissue inhomogeneous and 
anisotropic 

under construction 


Analytical 

A single intracellular domain 
Passive membrane conductance 


h,= Sl( v ~ e l) 


Simple electrode geometry 

Tissue assumed homogenous and 
isotropic 

much progress 


Bi-domain Model for the 
Microcapillary Bioreactor 
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...and impedance... 
Z(co)= 

^(L;(o)-^(0;co) 

h 



...and predict Z (co) 
as tissue parameters 
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Recap 


0 Focused & integrated effort 

• BioMEMS. . . Neural 
Engineering. . . Materials. . . 

Computational 

Neuroscience. . . Cellular 
Biology. . . Visualization 

0 Why are we so excited? 

• We have the very real 
potential of characterizing 
the biological responses to 
neural implants and then 
engineering new classes 
of microdevices to provide 
a permanent high-capacity 
interface to the brain 



Why the BIO, INFO, and 
__MICROProciram?_ 


0 Wide-open Challenges 

• Characterizing and modeling the biological (cellular and 
chemical) responses around a neural implant 

• Controlling the dynamic biological responses around a neural 
implant. 

• Designing, fabricating, and using “advanced” neural implants 
0 Collaboration Possibilities 

• Additional functionalities for implantable microdevices of the 
class that we are working on. 

• Exploring fundamentally new types of tissue-device interfaces. 

• Complementary studies of the neural interface (experimental 
and analytical) 

• Confocal microscopy of the neural interface 

• Sharing technologies, procedures, insights, etc... 

• New emergent ideas. . . 


Systems-level Analysis of Advanced 
__Neumgmsthetic^stems__ 
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Objective 2: Optimize 
Adaptive Controller 


Objective 7: Optimize neural 
interface 


Systems-level Approach for Advanced 
^_^_Neum£msthetic^stems^_^ 
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Objective 2: Develop Objective 1: Optimize neural 

adaptive controller to interface 
optimize system 
performance. 



Advanced Neuroprosthetic Systems 
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0 Underlying System Principles 

•Two-way communication with targeted neural systems 

•Harness neural plasticity to our advantage 

•Appropriately balanced “wet-side” and “dry-side” computation 


Perception, 

Decision, 

Detection 


Approach 


0 Four Project Areas 

> Direct neural control of actuators 

> Detection of novel sensory stimuli through 
monitoring neural activity 

> Neural control of behavior 

> Investigate signal transformations from 
ensembles of single neurons to local field 
potentials to EEG. 


Topics 


Project overview 

"S' Towards the Development of 3 rd -Generation Neural 
Implants (BIO, MICRO, and INFO) 

Bioactive Coatings to Control the Tissue Responses to 
Implanted Microdevices (Bio, micro, and info) 

££ Modeling the Device-Tissue Interface (BIO, MICRO, and 
INFO) 

□ Direct Cortical Control of a Motor Prosthesis 

(BIO, MICRO, and INFO) 

□ Neural Control of Auditory Perception 

□ Wrap-up 


Direct Cortical Control of Actuators 
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Fundamental Questions 


0 What are “optimal” real-time signal processing 
strategies for precise 3-D control of external, arm- 
related actuators in the presence of sensory 
distractions and/or physical perturbations to the 
arm? 

0 To what extent can we use composite neural 
signals [neuronal (unit) recordings, local field 
potentials, and brain-surface recordings] for control 
signals? 

0 How do we take advantage of inherent or 
controlled neural plasticity in order to optimize 
system performance? 


Experimental Preparation 


Train monkeys to perform tracking and/or reaching tasks. 
Record cortical responses with multichannel neural 
implants. 

Measure arm movement in 3-D space. 


Chronic Neural Recordings 


0 Multi-channel neural implants in motor and sensorimotor cortical areas. 
0 Eventually: Sub-dural electrodes for local potentials 



Extracellular recordings 








Neural 

Recording 

System 


Offline 

Analysis 


Perievent Histograms Target 1 , reference = C_rel, bin = 20 m 











Direct Cortical Control of Movement 


Green ball: Taraet Yellow ball : Actual hand position, or 

hand position estimated from cortical 
responses 
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Topics 


££ Project overview 

]$£ Towards the Development of 3 rd -Generation Neural 
Implants (BIO, MICRO, and INFO) 

)s( Bioactive Coatings to Control the Tissue Responses to 
Implanted Microdevices (Bio, micro, and info) 

Modeling the Device-Tissue Interface (BIO, MICRO, and 
INFO) 

££ Direct Cortical Control of a Motor Prosthesis (BIO, MICRO, 
and INFO) 

□ Neural Control of Auditory Perception(BIO, 
MICRO, and INFO) 

□ Wrap-up 



Neural Control of Auditory Perception 
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Fundamental Questions 


0 To what extent can we control auditory-mediated behavior using 
intra-cortical microstimulation (ICMS) through the neural interface? 
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Stimulator Neural Auditory 

Interface Cortex 

0 What are the information transmission characteristics of the 
multichannel neural implant in high-level cortical areas using 
ICMS? 

> Channel capacity (bits per second) 

> Channel reliability 

> Channel resolution 

> How can we optimize information transmission 

> Implant designs, Neural implant locations, Signal encoding strategies, 
Controlled neural plasticity 


Chronic Neural Recordings 


0 Multi-channel neural implants in primary auditory cortex 


Extracellular recordings 
in auditory cortex 
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Estimation of 
Neuronal 
Response 
Properties 


Algorithm Selection 



Behavioral performance to both sounds and 
cortical electrical stimulation 








Auditory Behavior 


• Lever-press sound or ICMS discrimination task 

• Center paddle hit starts trial, 2-tone pair presented 

• Reward obtained by signaling the correct stimulus 
sequence 
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Frequency Selectivity in Auditory Cortex 
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Signal Encoding Algorithm: 
__Frec|uenc^electivit^_ 


ICMS pattern is based 
solely on frequency 
selectivity of neurons 
recorded on an electrode 
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Behavioral Performance 
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Expected Results to ICMS Stimuli 



Auditory trial = □ 
ICMS Algorithml = ■ 
ICMS Algorithm2 = ■ 


Behavioral Curve 


RICMS 6 10/25 (Only Session) 
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Alternative Signal Encoding Algorithm: 
Cortical Activation Pattern 


For a given electrode, the unit firing pattern is used as a 
template for ICMS delivery 
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***Procedure is simultaneously duplicated on each active electrode 


Recap 


0 Focused & integrated effort 

• Neural Engineering. . . Signal 
Processing. . . Systems 
Neurophysiology. . . Visualization 


0 Why are we so excited? 

• We have the very real 
potential of developing new 
classes of neuroprosthetic 
systems to explore our ability 
to interact directly with the 
brain. 



BIO, INFO, and MICRO... 


0 Wide-open Challenges 

• Appropriate mathematical constructs for describing neural 
encoding and decoding. 

• Advanced data visualization techniques for understanding this 
new class of neural data. 

• Understanding signal transformations as a function of the 
spatial and temporal scale of the neural data. 

0 Collaboration Possibilities 

• Exploring new signal encoding and decoding strategies for 
particular neuroprosthetic applications. 

• Sharing technologies, procedures, insights, etc... 

• New emergent ideas. . . 


Topics 


Project overview 

"S' Towards the Development of 3 rd -Generation Neural 
Implants (BIO, MICRO, and INFO) 

Bioactive Coatings to Control the Tissue Responses to 
Implanted Microdevices (Bio, micro, and info) 

££ Modeling the Device-Tissue Interface (BIO, MICRO, and 
INFO) 

Direct Cortical Control of a Motor Prosthesis (BIO, MICRO, 
and INFO) 

^ Neural Control of Auditory Perception(BIO, MICRO, and 

INFO) 

□ Wrap-up 


Project Challenges 


0 Scientific 

• Overcoming engineering and scientific hurdles. 

• Identifying and fostering strategic alliances with appropriate 
external groups. 

• Crossing disciplines 

0 Management 

• Strategic planning 

• Resource allocation 

• Open and effective communication among the diverse project 
team 

• Team-building: Maintaining enthusiasm, energy, and focus 
after the initial “honeymoon” period 


“Insanely Intense 
hnterdjsc^Mnar^^Research 


“pieces of a puzzle” “easy synergism” 



What Does the Future Hold? 


“Perhaps within 25 years there will be some new ways to put 
information directly into our brains. With the implant technology that 
will be available by about 2025, doctors will be able to put something 
like a chip in your brain to prevent a stroke, stop a blood clot, detect 

an aneurysm, help your memory or treat a mental condition. You 
may be able to stream (digital) information through your eyes to the 
brain. New drugs may enhance your memory and fire up your 

neurons. — Dr. Arthur Caplan, 

Director of the Center of Bioethics, 

University of Pennsylvania 
Arizona Republic, Dec 27, 1998. 
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